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1. Introduction 



Let Xq = 0, Xi, X2, ... be a Markov chain with 

E, := P{Xn+i = z + 1 I X„ = z) = 1 - P(X„+i = t-l\X„ 

_ f 1 if i = 

~ \l/2+p, if 1 = 1,2,..., 



(1.1) 



where -1/2 < < 1/2, i = 1,2,. . .. 

Theorem A ([2], page 74) Let X^ he a Markov chain with transition probabilities given in 
(O). Define 

1-E, 1/2 -p. 



Ei 1/2 + p,' 
Then X„ is transient if and only if 

00 k 

Y.I[U^<00. 

k=li=l 



t = l,2,.... 



(1.2) 



(1.3) 



In case Pi > the sequence {Xi} describes the motion of a particle which starts at zero, 
moves over the nonnegative integers and going away from with a larger probability than 
to the direction of 0. We suppose throughout this paper that < pi < 1/2, i = 1, 2, . . . . 
In [3] we introduced the quantities 



D{m, n) :- 



and 



'0 if n = m, 

1 if n = m + 1, 

n—m—l j 

1+ E t[Um+iiin>m + 2 

j=i i=i 



lim D{m,n) =: Dim). 



(1.4) 



(1.5) 



Clearly (II. 3p implies that if the walk is transient then D{m) is finite for all m = 1, 2, . . .. 

The properties of this Markov chain, often called birth and death chain were extensively 
studied. Some of these results are mentioned e.g. in [3j. Our main concern in that paper 
was to study the local time of {X„}, defined by 



^{x, n) := : < k < n, Xk = x}, x = 0,1,2, 



n = l,2. 



(1.6) 
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and 

^{x) ■■= \im^^{x,n). (1.7) 
The first topic in that paper was to find upper class results for the local time. 
Theorem B Assume that Pr as R ^ oo. Then with probability 1 we have 

^{R) <2{l + e) D{R) log R (1.8) 

for any e > if R is large enough. 
Moreover, 

^{R) > MD{R) i.e. a.s. (1.9) 

for any M > 0. 

The next question was how small can the local time be. In particular, we studied the 
number of sites R where i{R) = 1. We found that the answer heavily depends on the 
sequence {pr}'^^^. 

We will say that the nearest neighbor (NN) random walk X* is slower than X„ (or 
equivalently, X„ is quicker than X*) if 

Pr<Pr for all i? = 1,2,... (1.10) 

It is obvious that the quicker is X„, the more sites with local time equal to 1 will occur. 
Remark 1. In (11.101) the required inequality could be relaxed to hold for all but finitely 
many R only, since finitely many pr have no effect on the asymptotic behavior of the walk. 
The same remark applies throughout the paper, when we require certain properties of the 
{Pr] system. 

Introduce the following notations: 

A(l,z,5) = -, 
A(2,z,fi) = -+ ^ 



I 



i log i ' 



i ilogi ilogiloglogi . . . log^_^ z 

where log^i = log(log^_]^ i). 

As a consequence of Theorem A, in [3] we obtained the following. (See also a more general 
result given in Theorem 3 of Menshikov et al. [^.) 
Fact 1 If for any K = 1,2,... 
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P. = 1 , 

then the Markov chain {Xn} is recurrent if B < 1 and transient if B > 1. 

In the spirit of Remark 1 above, it is enough if Pi takes the value given above with finitely 
many exceptions, but assuming that < < 1/2 for all 2 = 1,2,.... 

We proved in [3] that if Pi = — ^-^^-^ — ^ with B > 1, then we not only have infinitely many 

sites with local time 1, but we have infinitely many increasing runs of sites each having local 
time 1. More precisely we have 

Afl R B) B 

Theorem C Let {Xn} be an NN random walk with Pr = = — and B > 1. 

Then with probability 1 there exist infinitely many R for which 

aR + j) = l 

log log R 



for each j = 0, 1, 2, 



log 2 



However, if X* is transient but slower than X„ in Theorem C, then one might ask whether 
it still has infinitely many sites with local time 1. It turns out that this is not always true. 
James et al. [7] proved a surprising result which implies the following 

Af2 R B) 

Theorem D // {Xn} is an NN random walk with Pr = and B > 1, then with 

probability 1 Xn has only finitely many sites R with ^{R) = 1. 

In fact, they formulated their results in terms of cutpoints. Call the site R a cutpoint 
if for some k, we have X^ = R and {Xq,Xi . . .X^} is disjoint from {X^^i, Xk+2 ■ ■ ■}, i-e. 
Xi < R, i = 0,1,. . . ,k, Xk = R and Xi> R, i = k + l,k + 2,. . . 

The original version of Theorem C in [7] reads as follows. 
Theorem D* // {Xn} is an NN random walk with 

<U,U2...U,< 



k{\ogky - ^ ^ ^ - k{\ogk)0 

for some jS > 1 and positive constants Ci, C2, then {Xn} is transient and has only finitely 
many cutpoints a.s. 

Cutpoints and related intersection problems for more general stochastic processes have 
been investigated extensively in the literature, starting with Dvoretzky et al. [4j, Erdos and 
Taylor [5]. A nice summary of this topic is given by Lawler [8]. 
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For usual random walk (sums of i.i.d. random variables) we mention the following general 
result of James and Peres [6], where the definition of cutpoint is somewhat different from 
above. Sk is called a cutpoint there if p{Si,Sj) = for all such that < i < k < j , 
where p{x, y) is the one-step transition probability from x to y. 

Theorem E Any transient random walk {Sk} with hounded increments on the lattice Z'^ has 
infinitely many outpoints a.s. 

To formulate our main result, we introduce the following definitions. 

Call the site R a strong cutpoint if for some fc, we have = R, Xi < R, i = 0,1, . . . , k — 1 
and Xi > R, i = k + l,k + 2, . . .. Observe that Ris a strong cutpoint if and only if ^(i?) = 1, 
i.e. if it is visited exactly once. Clearly every strong cutpoint is a cutpoint, but not conversely. 
In words, i? is a cutpoint if upcrossings from R to R + 1 occurs only once, but R can be 
visited from R — 1 several times. 

In this paper we give a criteria for a transient NN random walk which determines whether 
the number of cutpoints (or strong cutpoints) is finite or infinite almost surely. 

Theorem 1.1. Let Xq = 0,Xi,X2, ... be a transient Markov chain with transition proba- 
bility Ei as in and < < 1/2, i = 1, 2, . . . Let D{n), n = 1,2, . . . be as in (II. Sp . 

• // 

oo -j^ 

Y ^^r^. < oo, (1.11) 

then {Xn] has finitely many cutpoints almost surely. 

• If D{n) < 5n\ogn {n > uq) for some 6 > and 

oo 

then {Xn} has infinitely many strong cutpoints almost surely. 

Remark 2. Observe that if the sum in (11.111) is finite then {Xn} has finitely many strong 
cutpoints. On the other hand, if the same sum is divergent and D{n) < 6n\ogn, then {Xn} 
has infinitely many cutpoints as well. 

Remark 3. The condition D{n) < 6n\ogn of the second statement is a technical one, most 
probably it can be removed. 

The above mentioned technical condition prevent us to establish the following 
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Conjecture 1.1 The number of cutpoints is finite if and only if the number of strong cut- 
points is finite. 

In Section 2 we will present some preliminary results. Sections 3 and 4 are devoted to 
prove Theorem 1.1. In Section 5 we give some examples and open problems. 

2 Preliminary results 

For < a < b < c integers define 

p(a, b, c) := P(min{j : j > m, Xj = a} < min{j : j > m, Xj = c} \ X^ = b), 
i.e. p{a, b, c) is the probability that a particle starting from b hits a before c. 
Lemma A For < a < b < c 

p(a,6,c) = 1 - — -. 

D{a, c) 

Especially, for n = 1,2,... we have 

P(0,l,n) = l--^, p(n,n+l,oo) = l--^. (2.1) 
It is easy to see that 

= l + D(n + l)f/„+i, 

U _ Din-l)~l _1 D{n)-D{n-1) + 1 
D[n) 2 D[n) + D[n — 1) — 1 

Then observe that for n > m + 2 

n— m— 1 j oo j 

D{m,n) = l+ l[Um+i = D{m)- ^ llU^+, = D{m) - U^+i ■ ■ .U^D{n) 

j=l i=l j=n—mi=l 

D{m+l)...D{n-l) '{ ii\ D{i))j^ ' 

We also define the number of upcrossings by 

i{R, n, t) := : < A; < n, Xk = R, Xk+i ^R + l}. (2.4) 
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e(i?,T):= lime(i?,n,T). (2.5) 



It was shown in [3] that 
Lemma B For R = 0,1,2, .. . 



mR) = L)=^-^(l-'-^Y'\ L = l,2,... (2.6) 
^ ' 2D{R) \ 2D{R) y ' ' ' ^ ' 

PKWT) = i) = 5^(l-J^)". i = 1.2.... (2.7) 

It is easy to see that i? is a cutpoint if and only if ^(-R, t) = 1- Recall that i? is a strong 
outpoint if and only if ^(-R) = 1. 
Denote the (random) set of 

• outpoints by C 

• strong cutpoints by 
Observe that 

C C. (2.8) 
We present the following exact probabilities. 
Lemma 2.1. For k = 1,2, . . . we have 

P{keC) = l~ p{k, k + l,oo) = (2.9) 

Proof. The statements (12.91) and (12.101) follow from Lemma B. 

To show (12.111) . we have to observe that after the first arrival to j + 1 the walk has to 
arrive to + 1 without hitting j, and from A; + 1 it must not return to k at all. Formally, by 
Lemma A 

P(j eC,keC) = il~ pij,j + l,k + l))(l - p{k, k + 1, oo)) = 



To show (12 .12^ . observe that after the first hit of j the walk has to go to j + 1. Then 
from J ■ + 1 it has to hit k before it goes back to j. From k it has to go to + 1, and from 
/c + 1 it must not return to k at all. Hence again by Lemma A, 



P{j eC\keC')= i-+p,){l-p{j,j + l,k))i-+pk]{l-p{k,k + l,oo)) 



This completes the proof of the Lemma. □ 
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Dij,k)Dik) 



Lemma 2.2. For any positive nan- decreasing function G{x), x > 0, the following two sums 

CX3 -1 OO -1 

V = V = 

;^2G(n)logn t'2G{[nlogn]) 

are equiconvergent. 

Proof. Under the condition of the Lemma we have 

"1 dx 1 dx 
< — — < 



consequently 



n G{x)\ogx G{n)\ogn Jn-i G{x)\ogx 



dx ^ 1 1 dx 
< > —r-. < —r-. h 



Similarly, 



2 G'(a;)logx ,^G(n)logn G(2)log2 J2 G'(x)logx 



dx ^ 1 1 1 dx 

— ^ nfL^ — 



I2 G{x\ogx) - ;^2<^([nlogn]) " G{1) G{3) J2 G{x\ogx) 
It remains to show that the integrals 

°° dx , f°° dx 

and 



G'(a;)logx J G(xlogx) 

are equiconvergent. This can be shown by using the substitution x = ylogy in the first 
integral above to get 

°° dx f°° 1 + log y dy 



G'(a;)logx J log ?/ + log log ?/ G{y\ogy)' 
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Clearly we have 



, dy ^ 1 + logy dy ^ dy 



G{y\ogy) J logy + log logy G'(ylogy) J G{y\ogy) 
with some < ci < C2, hence the Lemma. □ 

Lemma 2.3. If Xn and X* are two NN random walks such that X* is slower than Xn then 

D{n) < D*{n). 

Proof. If X* is slower than X„ then 

^ ^ 1/2 -p, ^ 1/2 -p* ^ 
' + - 1/2 + p* 

Hence from the definition of D{n) we get that 

D{n) < D*{n), (2.13) 

proving our Lemma. □ 

We will need the following Lemma from Polfeldt [10], which is a particular case of his 
theorem. 

Lemma C Let S{x) he a slowly varying function such that 

{\ogS{x))' 
lim -- — = — oo 

x^oo (log log Xj' 

and 

x->Qo (logx)' 

for some normalized differentiable slowly varying function L{x). Then 

S{t) 



I dt S{x) log L{x), as x ^ oo. 

Jx t 



Recall (see Bingham et al. ^ page 12-15) that a slowly varying function H{x) can be 
represented as 

H{x) = a{x) exp ^ dt^ , 

where a(x) — * a 7^ 0, e{x) — > as x — > 00. If a{x) = a, then H is normalized. 
Moreover, a differentiable slowly varying function is normalized if and only if 

xH'(x) 

, , > as X ^ 00. 

H[x) 
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3 Proof of the convergent part 

We follow the ideas of [7]. We have P(j G C\k e C) = 1/D{j, k + 1) for j < k. Observe that 
it is also the probability that 

P{j eC\keC,Fk+i) j<k, (3.1) 

where F^+i is any event determined by the future of the walk after it reaches + l for the first 
time. Let Cj^k be the set of outpoints in {2^,2''] and Aj^k '■= \Cj,k\ the number of outpoints 
in (2^2^=]. Define 

am := P{Ara,m+l > 0) (3.2) 

and 

2m-l ^ 

bm '■= min -— — — (3.3) 

fce{2™,2™+i] ^ L)(A;-2,A; + 1) ^ ^ 

On the event that A^.m+i > 0, let be the largest outpoint in Cm,m+i- We want to give 
a lower bound for the expeoted number of outpoints in (2™~^, 2*"+^] by oonditioning on the 
last outpoint in (2"^, 2'""'"^], if there is one: 

P(j eC) = E{Am-i,m+i) (3.4) 

j=2'"-i+l 

> 0) 

= amE(E(ylm-i,m+i| >o,C)) 
It is readily seen that if pi > 0, i = 1,2, . . ., then Ui < 1, i = 1,2, .. . and henoe 



and so 



D{m, n) < n — m. 



2m-l 



i=i * + J- 

with some c > 0. 

Henoe with constants c not necessarily the same on each appearance, 

oo oo oo 1 2^+1 

Y: P{Am,m+l) = E < E 1- E P(J e C7) 

m=l rra=l m,=l ™- j=2™~i+l 
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and by Borel-Cantelli lemma only finitely many of the events Ajn,m+i occurs with probability 
1, which proves the convergent part of Theorem 1.1. □ 

4 Proof of the divergent part 

Let ruk = [klogk] and 

Ak = {^{mk) = 1}. 

We prove that P{Aki.o.) = 1 which implies the divergent part of Theorem 1.1. By Lemma 
2.1 

1 + 2pm, ^ 1 



2D{mk) ~ 2D{[k\ogk])' 
so by Lemma 2.2, 

5]P(A,) = oo. 

k 

For n > m we have 

P(e(m) = 1, an) = l) = (l+ Pm] 777^ (l + Pn] ^ < ^ 



2 "^'V ^(771,71) V2 Z^H - D{m)D{n)H{m,n) 



with 

. D(m,n) 
n[m,n) 



D{m) 

It follows from ((231) that 

H(m,n) = 1 - ( 1 - —^1 . . . ( 1 



D{m) J \ D[n-l)) 

- ^ " """"P ("dR " • • • " D(n-l)) • 
Let e > and for given we split the set {^ > k} into 2 parts. Let 

f 1 1 + e 1 

4 = min £>fc: ->log^ . (4.1) 

I i=mk ^ J 
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• (1) ^>^1, 

• (2) k<e<ei. 

In case (1), using that H{m,n) is increasing in n for fixed m, we have for i > ii 

P(^. A,) ^ ™^ < MM < (1 + .)P,^.)P(^,). 

In the case (2) we use the inequality 1 — e^" > cm for < m < log((l + e)/e) with some 
c > to get 

H{mk, me) c ETJm, rm - nik 

Here and in what follows c, Cj denote some positive constants, the values of which might 
change from line to line. 
So we have for £ G (2) 

Now we show that 

log K 

with some positive constant 7 depending only on e. We know from (I4.ip that for £ G (2) we 
have 

We show that this implies that for large k we have i < k'^ with 7 > (1 + e/eY . If we assume 
the contrary that i > k'^ , then 

J2 Tu^ - 7 ~^ ' ~ -(loglog(m^ - 1) - loglogmfc) 
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1 hgnogi) 1 l+e 

~ 7 ] TT-j 7T > T log7 > log 

d log(A;logA;) d e 

which contradicts to ( 14.3^ . Hence d-i — 1 < k'^ ■, implying ( I4.2p . 
Consequently, 

^ V{AkA,)<cV{Ak) 

em 

Assembling these estimations, we have 

N N N N N 

E E P{AkAe)<il + e)Y: E P(A.)P(A,) + cE P(^;.) 

fc=lf=fc+l fc=l£=A:+l k=l 

Since e > is arbitrary, Borel-Cantelli lemma implies P{Aki.o.) = 1. □ 



5 Conclusions and open problems 

Our results are formulated in terms of the sequence {-D(-)} but it would be much more 
natural to formulate them in terms of the sequence {pi}- Even though we have an explicit 
expression of in terms of {pi}, usually it is not easy to see the asymptotics of D{-) 
and whether the sum in Theorem 1.1 is convergent or divergent by looking at {pi} only. 
Therefore we want to give some examples. 

In [3J we have shown 
Example 1. If pk = B / Ak with B > 1, then 

as i oo. Consequently, by Theorem 1.1 there are infinitely many strong outpoints a.s. 

It was shown also in [3j 
Example 2. If pk = A{K, k, B)/A with K >2 and B > 1, then 

zlogiloglogz. . .log^_ii 
^ ' B-1 

as i ^ oo. Consequently, by Theorem 1.1 we have finitely many outpoints a.s. 
Recall that the case K = 2 corresponds to Theorem D. 

Of course, if the NN walk is quicker than the walk in Example 1, (e.g. pk = ck~'^ with 
a < 1), then we have infinitely many strong cutpoints a.s. On the other hand, if the NN 
walk is slower than the walk in Example 2, then we have finitely many cutpoints a.s. 
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The above two examples show that the jump from finitely many to infinitely many cut- 
points is for 

" 4 (fc + km) 

with some f{k) oo. It is not hard to show that if f{k) = (log A;)" with < a < 1, then 
we still have finitely many outpoints a.s. Now we show a more precise result which implies 
this one. 

Theorem 5.1. Let {Xn} be an NN random walk with 

1/1 1 \ 

Pik = 7 7 + 



4 \k k{\og\og k)f^ J ' 

then we have finitely many cutpoints a.s. if (3 > 1 and infinitely many strong cutpoints a.s. 
«//3<l. 

Proof. Let 

k oo 

Tk^JJUi, tk = ^ri, /c = l,2, ... 

i=l i=k 

Then it is easy to see that D{k) = t^/rk. 
For A; — > oo we obtain 



= Tt/^ = exp(-4p, + 0{pi)) 
1 + 2pfe 



and 



k k / k / -t -i\ 

r, = exp(-4 ^p, + 0($:pD) = exp - ^ - + + 0(i; 

= exp (- f- + -—^ -^ du + 0(1)) . 

y Js \u u(log log uj'^ y y 



Hence 

Cl 

k 



du \ C2 ( du \ , , 

exp — / — - — -r < Tfc < — exp — / — - — -r (5.1) 

y ^3 u{logloguy J k \ Jz u\ioglogu)P J 



with some positive constants Ci, C2. Consequently, 



( n du \ ( h du \ , , 

ciE-exp -/ ^rn — 7^ <^fe<c2E-cxp -/ ^ — ^ . 5.2 

i=feJ V M(loglogM)Py . V i3 M(loglogM)^y 



J= 

14 



Moreover, 



To find the asymptotics of the above integral, we will apply Lemma C, with 

du \ 



S{y) = exp 1^-^ 



M(log logu)'^ 



and 

L{x) = e('°siog^)''. 

Choosing S{-) and L{-) as above, all the conditions of Lemma C are met and we conclude 
that 

/ - exp - / — — — ~ (log log exp - / — — — . 

Jk y \ J3 u{loglogu)P J \ J3 u[loglogu)P J 

From f l5.ll) and (15 .2^ we obtain 

ci k (log log kf < D(k) = — <C2k (log log kf. 

Tk 

This combined with Theorem 1.1 proves Theorem 5.1. □ 
Lemma 2.4 easily implies the following 

Corollary 5.1 // is an NN random walk with 

1/1 I \ 



Pk 



< 



A \k k{\og\ogk)^ 



and P > I, then X„ has finitely many outpoints a.s. 

On the other hand, if {Xn} is an NN random walk with 

1/1 1 \ 

Pk>-r\T + 



A\k k{\og\og k)f^ J 
and P < 1, then X„ has infinitely many strong outpoints a.s. 
Now we present some related open problems. 
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• (1) It would be interesting to know whether Theorem 1.1 also holds for the number of 
sites with ^{R) = a or $^{R, t) = a for any fixed integer a > 1, i.e. whether we have the 
same criteria for {^{R) = a} and {^{R, T) = a} to occur infinitely often almost surely 
for any positive integer a. 

• (2) Call the site R a vjeak cutpoint if for some k, we have Xk = R, Xi < R, i = 
0, 1, ... , k — 1 and Xi > R, i = k + 1, k + 2, . . .. One would like to know whether 
Theorem 1.1 can be extended for the number of weak cutpoints. 

• (3) It would be interesting to know whether Theorem 1.1 holds for cutpoints with a 
given local time, i.e. for {i{R) = a, ^{R, j) = 1}, or in general {i{R) = a, ^{R, j) = b} 
infinitely often almost surely, with positive integers a, b. 

• (4) Theorem B gives limsup behavior of the local time. One might ask how does it 
change if we want to consider the limsup of the local time restricted to the cutpoints. 
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